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(54) Improved video conference data transfer system 



(57) The present invention provides a system for 
transferring multiplexed data including image data and 
voice data through at least a communication line 
between at least two terminal devices. The system 
includes : a monitoring unit for monitoring a current 
state of transfer of the multiplexed data on the commu- 
nication line ; and a controller unit for controlling trans- 
fers of 'the image data and the voice data, so that a 
priority is given to the transfer of the voice data whilst 
the transfer of the image data is controlled or discontin- 
ued in order to continue a current transfer of the voice 
data when the monitoring unit recognizes a delay in 
transfer of the multiplexed data on the communication 
line. 
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Description 

[0001] The present invention relates to an improve- 
ment o1 a video conference data transfer system, and 
more particularly to an improvement of a video confer- 
ence data transfer system for transferring image data 
and voice data on networks. 

[0002] Video conferences have already been held by 
transferring image data and voice data through commu- 
nication lines between terminal devices such as per- 
sonal computers. FIG, 1 is a block diagram illustrative of 
a conventional video conference data transfer system 
for transferring image data and voice data for the video 
conference. The conventional video conference data 
transfer system comprises two terminal devices 51 and 
65 and a communication line 63 connecting the two ter- 
minal devices 51 and 65 to each other or transferring 
image data and voice data for the video conference. 
The two terminal devices 51 and 65 will be referred to as 
a first terminal device 51 and a second terminal device 
65 which have the same structure and configurations. 
The first and second terminal devices 51 and 65 have 
first and second microphones 52 and 72 respectively for 
capturing voices. The first and second terminal devices 
51 and 65 also have first and second cameras 53 and 
73 respectively for capturing images. The first and sec- 
ond terminal devices 51 and 65 also have first and sec- 
ond data compressors 56 and 70 respectively. The first 
compressor 56 is connected to the first micrc^hone 52 
and the first camera 53 for receiving image data cap- 
tured by the first camera 53 and voice data captured by 
the first microphone 52 to compress the received image 
data and the received voice data. The second compres- 
sor 70 is also connected to the second microphone 72 
and the first camera 73 for receiving image data cap- 
tured by the second camera 73 and voice data captured 
by the second microphone 72 to compress the received 
image data and the received voice data. The first and 
second terminal devices 51 and 65 also have first and 
second multiplexers 58 and 68 respectively for multi- 
plexing image data and voice data. The first multiplexer 
58 is connected to the first data compressor 56 for 
receiving the compressed image data and the corrv 
pressed voice data from the first data compressor 56 to 
multiplex the compressed image data and the com- 
pressed voice data. The second multiplexer 68 is con- 
nected to the second data compressor 70 for receiving 
the compressed image data and the compressed voice 
data from the second data compressor 70 to multiplex 
the compressed image data and the compressed voice 
data. The first and second terminal devices 51 and 65 
also have first and second transmission data buffers 60 
arKi 66 respectively for temporary storing the multi- 
plexed data. The first transmission data buffer 60 is con- 
nected to the first multiplexer 58 for receiving and 
temporary storing the multiplexed data. The second 
transmission data buffer 66 is connected to the secor>d 
multiplexer 68 for receiving and temporary storing the 



multiplexed data. The first and second terminal devices 
51 and 65 also have first and second communication 
devices 62 and 64 respectively The first and second 
communication devices 62 and 64 are connected to 
5 each other through the communication line 63. The first 
communication device 62 is connected to the first trans- 
mission data buffer 60 for receiving the first multiplexed 
data from the first transmission data buffer 60 to trans- 
mit the first multiplexed data through the communication 
10 line 63 to the second communication device 64. On the 
other hand, the second communication device 64 is 
connected to the second ti ansmission data buffer 66 for 
receiving the second multiplexed data from the second 
transmission data buffer 66 to transmit the second mul- 
is tiplexed data through the communication line 63 to the 
first communication device 62. The first communication 
device 62 receives the second multiplexed data from the 
second communication device 64, whilst the second 
comrmjnication device 64 receives the first multiplexed 
20 data from the first communication device 62. The first 
and second terminal devices 51 and 65 further have first 
and second receiving data buffers 61 and 67 respec- 
tively for tenrporary storing the received data. The first 
receiving data buffer 61 is connected to the first commu- 
25 nicatioh device 62 for receiving the second nmjitiplexed 
data from the first communication device 62 to tempo- 
rary store the second multiplexed data. The second 
receiving data t>uffer 62 is connected to the second 
communication device 64 for receiving the first multi- 
30 plexed data from the second communication device 64 
to temporary store the first multiplexed data. The first 
and second terminal devices 51 and 65 further have first 
and second demultiplexers 59 and 69 respectively for 
separating tiie multiplexed data into voice and image 
35 data. The first demultiplexer 59 is connected to the first 
receiving data buffer 61 for receiving the second multi- 
plexed data to demultiplex the second muftipiexed data 
into second image data and second voice data sepa- 
rated from each other. The second demultiplexer 69 is 
40 connected to the second receiving data buffer 67 for 
receiving the first multiplexed data to demultiplex the 
first multiplexed data into first image data and first voice 
data separated from each other. The first and second 
terminal devices 51 arvj 65 further have first and second 
45 decompressors 57 and 69 respectively for decompress- 
ing the image data and tfie voice data separately. The 
first decompressor 57 is connected to the first demulti- 
plexer 59 for receiving the second image data and the 
second voice data to expend the second image data 
50 and the second voice data separately. The second 
decompressor 71 is connected to the second demulti- 
plexer 69 for receiving the first image data and the first 
voice data to expend the first image data and the first 
voice data separately. The first and second terminal 
55 devices 51 and 65 further have first and second speak- 
ers 54 and 74 as well as first and second displays 55 
and 75 respectively for re-producing the voice data arKi 
the image data. The first speaker 54 is connected to the 
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TJi^TT^f '^^'^"9 second voice 
date from the first decompressor 57 to reproduce the 
second voice data as a voice. The firet display 55 tea so 

second ,mage data from the first decompressor^/ to 

hp «f ^'5- ^^'^ ^^""^ « "'"nected to 
ial frr^iS^"'"'"'"'^^ for receiving thefirst voice 
.hP H«t V^"^ decompressor 71 to reproduce 
the first voice data as a voice. The second disptey 75 is 
diso connected to the second decompress^ 7i for 
receiving the first image data from the^ond decom- 
pressor 71 to reproduce the first image date on a screen 
of the second display 75. 

^31 In Japanese laid-open patent publication No. 4- 
58687. a method of controlling an amount of generated 

rSln^H °""^- ^ ''^'^^ *^ans- 

m«sion buffer is supervised to control an amount of 

generaton of image codes for controlling the amount of 
.he voJrd^r"*'" " "^^^^ - ^ *o 

^!^K 'aid-open patent publication No. 9- 

1 1 6885. an apparatus and a method of management of 
a communication load of a television conference system 

? ^ TT^' '^^"^ " conference 
system are disclosed, wherein a plurality of terminal 
devices are located at different places and connect^ 
through communication lines to each other. Loads on 
communications of the communication lines are super- 
vised so that if the load Is over a predetermined ^ 

^cJrr'' *° ^*^P'«y °^ "^9es and 

voices of a person which is not speaking. This puWica- 
•on do^not address changing voice and image data 
Si °' «ie television conferee 

communication lines for transfer- 
ring the compressed and multiplexed date for the video 
conference may comprise various types of commination 
Irnes, for example, high speed communication lines 

POTVir*" '"^ ^'"^ ^ general lines s^ci 2 
POTS. AHhough the high speed communication lines 
such as ^DN and ATM are of course preferable, thosi 
h^gh speed communication lines are still minor and the 
majonty «„T,„^nicatlon lines are the general lines such 

[0006] The general lines such as POTS have a low 
capacity of transferring data, for which reason a larae 
size of the general lines is thus required to transfer a 
large amount of date at the required high speed The 
-mage date and the voice date are once coi^r^ed in 
the transmitter side terminal device for transmission of 
the compressed date to the receiving side terminal 
device before the receiving side terminaT device d3 
presses the compressed image and voice date to repro- 
duce the image and voice date separately. The data 
ranker rate of the general communication line POTS is 
-nsuflicient for smoothly reproducing the image date 

and the voice date so that discontinuations of the image 
and voice may appear during the video conference and 
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each other. speaker are asynchronous with 

s Ehe^niS? "•"•9'^bepossibletocon- 
conference even if the image and the voice are 
asynchronous with each otheraZigh it is of «u^^ 
^esirable. It might also be possible to continS^ 

^n^'rf r ^'e" " tf'e image is dis 

w ^"2"^.f' it is Of coui^e undesirable NoLfth- 

roOM? °n'y When the voice is discontinued. 
SeSLth^tho"^/^ 9^"®'^' «^"^n*cation lines 
^tf f J ""^^^ conference system, it is difficult to 

rate for smooth re-production of the image date and the 
ln^T:'^°^ discontinuation. In ordSto con 
tinue the vKleo conference, it is essential to continue the 

required transfer rate of date to be transferred on the 
^--;.°«t'Onlineexceedsthecapacityofthec2^. 
n^cabon line or if the terminal device has an over-load. 

'^"11" '^^"^'^^ »he voice date to ' 

® ""^9^ discontinued. 
rSL to 1 *T ''^^ «^«="-«tances. it had been 
°" ^«^eo conference sys- 

rare'p^srr^"^"^^''-^^^-'-''^ 

30 ^"'^"S'y 'tis an Object Of the present inven- 

30 jontoprovideanimprovedvideoconferencesystemfi 
^ansfernng v^eo data and image date from thi aboS 

oS In^ ^ °^ P'^^ *™'e"«on to 

provide an improved video conference system for so 

3S transferring video date and image date as to ^ mit a 

required date transfer rate is beyond a current capacity 
of a general communication fine in use 
40 l^ZJ " ^ "^^^^ "'"'^ °*the present invention 

Sfp^H °' ^'^'^ts and a plurality of 

.TanTfc . ^"^"^y required Jate 

transfer rate is beyond a current capacity o?a gene^ 

rL'n. Changed so S 

to continue the transfer of the voice date for permitting a 
continuation of video conference Pe^ni'tting a 

ro;Sidfr^*^'"'^^'*'«*°'*'«P^^"t'"-e"«on 
to provide an improved video conference system for so 
so transfemng video date and image date as to Srmiti 
cont.nuat.on of video conference even if a CpS^ntei 
into an over-load stete. 

S7n n!^V '"'•''^ ""^^ °' present inven- 
5s ".^ ^" conference system 

^^'f^f !f'"'^'«y°'''™9edataformafsandap'uSr 
rty Of vdeo date formats so that if a CPU enters into an 
overload stete. then the currently image data pro^^ 
•ng rate is decreased to continue the transfer of the 
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voice data for permitting a continuation of video confer- 
ence. 

[001 5] It is still more object of the present invention to 
provide a novel method of controlling transfers of video 
data and image data through a communication line 5 
between terminal devices for implementation of a video 
conference free from the above problem. 
[0016] It is moreover object of the present invention to 
provide a novel method of controlling transfers of video 
data and image data through a communication line io 
between terminal devices for implementation of a video 
conference so as to permit a continuation of video con- 
ference even if the currently required data transfer rate 
is beyond a current capacity of a general communica- 
tion line in use. 

[001 7] It is another object of the present invention to 
provide a novel method of controlling transfers of video 
data and image data through a communication line 
between terminal devices for implementation of a video 
conference, so that if the cun^ently required data transfer so 
rate is beyond a cun-ent capacity of a general communi- 
cation line in use. then the cun-ently used image data 
format and voice format are changed so as to continue 
the transfer of the voice data for permitting a continua- 
tion of video conference. 25 
(001 8] It is still another object of the present invention 
to provide a novel method of controlling transfers of 
video data and image data through a communication 
line between terminal devices for implementation of a 
video conference so as to permit a continuation of video 3o 
conference even if a CPU enters into an over-load state. 
(001 9] It is yet another otjject of tiie present invention 
to provide a novel method of controlling transfers of 
video data and image data through a communication 
line between terminal devices for implementation of a 35 
video conference so that if a CPU enters into an over- 
load state, then the currently image data processing 
rate is decreased to continue tiie transfer of the voice 
data tor permitting a continuation of video conference. 
(0020] The first present invention provides a system 4o 
for transfening multiplexed data including image data 
and voice data through at least a communication line 
between at least two terminal devices. The system 
includes : a monitoring unit for monitoring a current 
state of transfer of the multiplexed data on the commu- 45 
nication line ; and a controller unit for controlling trans- 
fers of the image data and the voice data, so that a 
prfority is given to the transfer of the voice data whilst 
the transfer of the image data is controlled or discontin- 
ued in order to continue a current tiansfer of the voice so 
data when the monitoring unit recognizes a delay in 
transfer of the multiplexed data on the communication 
line. 

[0021] The second present invention provides a sys- 
tem for iransfen-ing multiplexed data including image ss 
data and voice data through at least a communication 
line between at least two terminal devices. The system 
includes : a monitoring unit for monitoring a load of a 



processor provided in each of the terminal devices : and 
a controller unit for controlling processing speeds of the 
image data and the voice data, so that the priority is 
given to tiie processing of the voice data whilst the 
processing of the image data is controlled or discontin- 
ued in order to continue the cun-ent processing speed of 
the voice data when the monitoring unit recognizes an 
over-load of the processor. 

[0022] The above and other objects, features and 
advantages of the present invention will be apparent 
from the following descriptions. 
[0023] Pretended embodiments according to the 
present invention wfll be described in detail with refer- 
ence to the accompanying drawings. 

FIG. 1 is a block diagram illustrative of the conven- 
tional video conference data transfer system for 
transfemng image data and voice data for the video 
conference. 

FIG. 2 is a block diagram illustrative of a novel video 
corTference system for transferring image data and 
voice data through a general communication line 
between twotemiinal devices in a first embodiment 
in accordance with the present invention. 
FIG. 3 is a block diagram illustrative of a novel video 
conference system for ti^nsfemng image data and 
voice data through a general communication line 
between two terminal devices in a second OTbodi- 
ment in accordance with the present invention. 



[0024] The first present invention provides a system 
for transferring multiplexed data including image data 
and voice data through at least a comnwnication line 
between at least two terminal devices. The system 
includes : a monitoring unit for monitoring a current 
state of transfer of the multiplexed data on the commu- 
nication line : and a controller unit for controlling trans- 
fers of the image data and the voice data, so that a 
priorrty is given to the transfer of the voice data whilst 
the transfer of the image data is controlled or discontin- 
ued in order to continue a current transfer of the voice 
data when the monitoring unit recognizes a delay in 
transfer of the multiplexed data on the communication 
line. 

[00251 It is preferable that the confc^oller unit controls 
the current transfer of the voice data only when the 
monitoring unit still recognizes the delay in transfer of 
the multiplexed data on the communication line even 
after the ti-ansfer of the image data is discontinued. 
[0026] It is also preferable that the monitoring unit is 
operated to monitor an amount of the muftiplexed data 
accumulated in a data storage unit for subsequent 
transfer through the communication line so that only 
when tiie amount of the multiplexed data accumulated 
in the data storage unit exceeds a predetermined level, 
tiien the conf oiler unit performs the control operation. 
[0027] It is also preferable that the controller unit con- 
trols the ti-ansfer of the image data by changing an orig- 
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inal image data format defining a first data transfer rate 
as a normal data transfer rate to other image data for- 
mat defining a second data transfer rate which is lower 
than the first data transfer rate when the monitoring unit 
recognizes the delay in transfer of the multiplexed data 5 
on the communication line. 

[0Q28] It is further preferable that the controller unit 
further controls the transfer of the image data by return- 
ing the other image data format into the original image 
data format when the monitoring unit recognizes no /o 
delay in transfer of the multiplexed data on the commu- 
nication line. 

[0029] It is also preferable that the controller unit fur- 
ther controls the transfer of the image data by further 
changing the other image data fomrtat into still other 15 
image data format defining a third data transfer rate 
which is lower than the second data transfer rate when 
the mor^toring unit still recognizes the delay in transfer 
of the nnultiplexed data on the communication line. 
[0030] It is further preferal)le that the controller unit 30 
further controls the transfer of the image data by return- 
ing the still other image data format into the other image 
data format when the ntonitoring unit recognizes no 
delay in transfer of the multiplexed data on the commu- 
nication line. 25 
[0031] It is also preferable that the controller unit fur- 
ther controls the transfer of the image data by discontin- 
uing the transfer of the image data only when the 
monitoring unit still recognizes the delay in transfer of 
the multiplexed data on the comnrunication line even 30 
after the controller unit changes the Image data format 
into a final image data format defining a lowest data 
transfer rate. 

[0032] It is further preferal^e that the controller unit 
further controls the transfer of the image data by re- 35 
starting the image data transfer when the monitoring 
unit recognizes no delay in transfer of the nwltiplexed 
data on the communication line. 
[0033] It is also preferatrfe that the monitorirg unit and 
the controller unit are realized by a data controller pro- 40 
vided in each of the terminal devices. 
[0034] It is also preferable that monitoring unit further 
monitors a load of a processor provided in each of the 
terminal devices for permitting the controller unit to con- 
trol processing speeds of the image data and the voice 45 
data by the processor, so that the priority is given to the 
processing of the voice data whilst the processing of the 
image data is controlled or discontinued in order to con- 
tinue the current processing speed of the voice data 
when the monitoring unit recognizes an over-load of the so 
processor. 

[0035] It is also preferable that the controller unit con- 
trols the current processing speed of the voice data only 
when said controller still recognizes said over-load of 
said processor even after the processing of the image 55 
data has been discontinued. 

[0036] It is also preferable that the monitoring unit is 
operated to nronitor an amount of the multiplexed data 



accumulated in a data storage unit for subsequent 
transfer through the communication line so that only 
when the amount of the multiplexed data accumulated 
in the data storage unit is less than a predetermined 
level, then the controller unit performs the control oper- 
ation. 

[0037] It is also preferable that the controller unit con- 
trols the processing speed of the image data by chang- 
ing an original image data processing speed format 
defining a first data processing speed as a normal data 
processing speed to other image data processing 
speed format defining a second data processing speed 
which is lower than the first data processing speed 
when the monitoring unit recognizes the over-load of 
the processor. 

[0038] It is also preferable that the controller unit fur- 
ther controls the processing speed of the image data by 
returning the other image data processing speed format 
into the original image data processing speed format 
when the nwnitoring unit recognizes no over-load of the 
processor. 

' [0039] It is also preferable thaf the controller unit fur- 
ther controls the processing speed of the image data by 
further changing the other image data processing 
speed format into still other image data processing 
speed format defining a third data processing speed 
which is lower than the second data processing speed 
when the monitoring unit still recognizes the over-load 
of the processor. 

[0040] It is also preferable that the conto-oller unit fur- 
tiier controls the processing speed of the image data by 
returning the still other image data processing speed 
format into the other image data processing speed for- 
mat when the monitoring unit recognizes no overload 
of the processor, 

[0041] It is also preferable that tiie controller unit fur- 
ther controls the processing speed of the image data by 
discontinuing the processing of the image data only 
when the monitoring unit still recognizes the over-load 
of the processor even after the controller unit changes 
the image data processing speed format into a final 
image data processing speed format defining a lowest 
data processing speed. 

[0042] It is also preferable that the controller unrt fur- 
ther controls the processing speed of the image data by 
re-starting the still other image data compression 
processing when, the monitoring unit recognizes no 
over-load of the processor. 

[0043] It is also preferable that the controller unit con- 
trols the processing speed of the image data by control- 
ling an operation of a compressor provided each of the 
terminal devices. 

[0044] The second present invention provides a sys- 
tem for transferring multplexed data including image 
data and voice data through at least a communication 
line between at least two terminal devices. The system 
includes ; a monitoring unit for monitoring a load of a 
processor provided in each of the terminal devices ; and 
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a controller unit for controlling processing speeds of the 
image data and the voice data, so that the priority is 
given to the processing of the voice data whilst the 
processing of the image data is controlled or discontin- 
ued in order to continue the current processing speed of 5 
the voice data when the monitoring unit recognizes an 
over-load of the processor 

[0045] It is preferable that the controller unit controls 
the current processing speed of the voice data only 
when said controller still recognizes said over-load of 10 
said processor even after the processing of the image 
data has been discontinued. 

[0046] It Is also preferable that the monitoring unit is 
operated to monitor an amount of the multiplexed data 
accumulated in a data storage unit for subsequent is 
transfer through the communication line so that only 
when the amount of the multiplexed data accumulated 
in the data storage unit is less than a predetermined 
level, then the controller unit performs the control oper- 
ation. 20 
[0047] It is also preferable that the controller unit con- 
trols the processing speed of the image data by chang- 
ing an original image data processing speed format 
defining a first data processing speed as a normal data 
processing speed to other image data processing 25 
speed fornrtat defining a second data processing speed 
which is lower than the first data processing speed 
when the nronitoring unit recognizes the over-load of 
the processor. 

[0048] It is also preferable that the controller unit fur- 30 
ther controls the processing speed of the image data by 
returning the other image data processing speed format 
into the original image data processing speed format 
when the monitoring unit recognizes no over-load of the 
processor. 35 
[0049] It is also preferable that the controller unit fur- 
ther controls the processing speed of the image data by 
further changing the other image data processing 
speed format into still other image data processing 
speed format defining a third data processing speed 40 
which is lower than the second data processing speed 
when the monitoring unit still recognizes the over-load 
of the processor. 

[0050] It is also preferable that the controller unit fur- 
ther controls the processing speed of the image data by 45 
returning the still other image data processing speed 
format into the other image data processing speed for- 
mat when the monitoring unit recognizes no over-load 
of the processor. 

[0051] It is also preferable that the controller unit fur- so 
ther controls the processing speed of the image data by 
discontinuing the processing of the image data only 
when the monitoring unit still recognizes the over-load 
of the processor even after the controller unit changes 
the image data processing speed format into a final 55 
image data processing speed format defining a lowest 
data processing speed. 

[0052] It is also preferable that the controller unit fur- 



ther controls the processing speed of the image data tiy 
re-starting the still other image data connpression 
processing when the monitoring unit recognizes no 
over-load of the processor. 

[0053] It Is also preferatJie that the controller unit con- 
trols the processing speed of the image data by control- 
ling an operation of a conpressor provided each of the 
terminal devices. 

[0054] It is also preferable that the monitoring unit fur- 
ther monitors a cun-ent state of transfer of the multi- 
plexed data on the communication line so as to permit 
the controller unit to further control transfers of the 
image data and the voice data, so that a priority is given 
to the transfer of the voice data whilst the transfer of the 
image data is controlled or discontinued in order to con- 
tinue a current transfer of the voice data when the mon- 
itoring unit recognizes a delay in transfer of the 
multiplexed data on the communication line. 
[0055] It is also preferable that the controller unit con- 
trols the current transfer of the voice data only when the 
monitoring unit still recognizes the delay in transfer of 
the multiplexed data on the communication line even the 
transfer of the image data is discontinued. 
[0056] It is also preferable that the monitoring unit is 
operated to monitor an amount of the multiplexed data 
accumulated in a data storage unit for subsequent 
transfer through the communication line so that only 
when the amount of the nujltiplexed data accumulated 
in the data storage unit exceeds a predetermined level, 
then the controller unit performs the control operation. 
[0057] It is also preferable that the controller unit con- 
trols the transfer of the Image data by changing an orig- 
inal image data format defining a first data transfer rate 
as a normal data transfer rate to over image data format 
defining a second data transfer rate which is lower than 
the first data transfer rate when the monitoring unit rec-' 
ognizes the delay in transfer of the multiplexed data on 
the communication line. 

[0058] It is also preferable that the controller unit fur- 
ther controls the transfer of the image data by returning 
the other innage data format into the original image data 
format when the monitoring unit recognizes no delay in 
transfer of the multiplexed data on the communication 
line. 

[0059] It is also preferable that the controller unit fur- 
ther controls the transfer of the image data by further 
changing the other image data format into still other 
image data format defining a third data transfer rate 
which is lower than the second data transfer rate when 
the monitoring unit still recognizes the delay in transfer 
of the multiplexed data on the communication line. 
[0060] It is also preferaWe that the controller unit fur- 
ther controls the transfer of the image data by returning 
the still other image data format into the other image 
data format when the monitoring unit recognizes no 
delay in transfer of the multiplexed data on the commu- 
nication line. 

[0061] It is also preferable that the conti'oller unH fur- 
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ther contrds the transfer of the image data by discontin- 
uing the transfer of the image data only when the 
monitoring unit stilt recognizes the delay in transfer of 
the multiplexed data on the communication line even 
after the controller unit changes the image data format s 
into a final image data format defining a lowest data 
transfer rate. 

[0062] It is also preferable that the controller unit fur- 
ther controls the transfer of the image data by re-start- 
ing the image data transfer when the monitoring unit io 
recognizes no delay in transfer of the multiplexed data 
on the communication line. 

[0063] It is also preferable that the monitoring unit and 
the controller unit are realized by a data controller pro- 
vided in each of the terminal devices. is 

FIRST EMBODIMENT: 

[0064] A first embodiment according to the present 
?! invention will be described in detail with reference to so 

FIG. 2 which is a block diagram illustrative of a novel 
video conference system for transferring image data 
and voice data through a general communication line 
between two terminal devices. The novel video confer- 
:■■ ence data transfer system comprises two terminal 2S 

i devices 1 and 1 5 and a communication line 1 4 connect- 

I ing the two terminal devices 1 and 15 to each other or 

I transferring image data and voice data lor the video 

conference. The two terminal devices 1 and 15 will be 
^ refen^ed to as a first terminal device 1 and a second ter- so 

:^ minal device 1 5 which have the same structure and con- 

figurations. The first and second terminal devices 1 and 
1 5 have first and second microphones 2 and 24 respec- 
I tively for capturing voices. The first and second terminal 

devices 1 and 15 also have first and second cameras 3 35 
and 25 respectively for capturing images. The first and 
second terminal devices 1 and 15 also have first and 
second data compressors 6 and 22 respectively. The 
first contpressor 6 is connected to the first microphone 
2 and the first camera 3 for receiving image data cap- 40 
I tured by the first camera 3 and voice data captured by 

i the first microphone 2 to compress the received image 

I data and the received voice data. The second compres- 

I sor 22 is also connected to the second nracrophone 24 

i and the first camera 25 for receiving image data cap- 45 

tured by the second camera 25 and voice data captured 
by the second microphone 24 to compress the received 
image data and the received voice data. The first and 
second terminal devices 1 and 15 also have first and 
second multiplexers 8 and 20 respectively for multiplex- 50 
ing image data and voice data. The first multiplexer 8 is 
connected to the first data compressor 6 for receiving 
the compressed image data and the compressed voice 
data from the first data compressor 6 to multiplex the 
compressed image data and the compressed voice 55 
data. The second multiplexer 20 is connected to the 
second data compressor 22 for receiving the com- 
pressed image data and the compressed voice data 
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from the second data compressor 22 to multiplex the 
compressed image data and the compressed voice 
data. The first and second terminal devices 1 and 15 
also have first and second transmission data buffers 1 1 
and 17 respectively for tempa-ary storing the multi- 
plexed data. The first transmission data buffer 1 1 is con- 
nected to the first multiplexer 8 for receiving and 
temporary storing the multiplexed data. The second 
transmission data buffer 17 is connected to the second 
multiplexer 20 for receiving arxJ temporary storing the 
multiplexed data. The first and second terminal devices 
1 and 15 also have first and second communication 
devices 13 and 16 respectively The first and second 
communication devices 13 and 16 are connected to 
each other through the communication line 14. The first 
communication device 13 is connected to the first trans- 
mission data buffer 1 1 for receiving the first multiplexed 
data from the first transmission data buffer 1 1 to trans- 
mit the first multiplexed data through the communication 
line 14 to the second comnuinication device 16. On the 
other hand, the second communication device 16 is 
connected to the second transmission data buffer 1 7 for 
receiving the second multiplexed data from the second 
transmission data fcaiffer 17 to transmit the second nrujl- 
tiplexed data through the communication line 14 to the 
first communication device 13, The first communication 
device 13 receives the second multiplexed data from the 
second communication device 16. whilst the second 
communication device 16 receives the first multiplexed 
data from the first communication device 13. The first 
and second terminal devices 1 and 1 5 further have first 
arxJ second receiving data buffers 12 and 18 respec- 
tively for temporary storing the received data. The first 
receiving data buffer 12 is connected to the first commu- 
nication device 13 for receiving the second multiplexed 
data from the first communication device 13 to tempo- 
rary store the second multqalexed data. The second 
receiving data buffer 13 is connected to the second 
communication device 16 for receiving the first multi- 
plexed data from the second communication device 16 
to temporary store the first multiplexed data. The first 
ar)d second terminal devices 1 and 16 further have first 
and second demultiplexers 9 and 21 respectively for 
separating the multiplexed data into voice arxl image 
data. The first demultiplexer 9 is connected to the first 
receiving data buffer 12 for receiving the second multi- 
plexed data to demultiplex the second multiplexed data 
into second image data and second voice data sepa- 
rated from each other. The second demultiplexer 21 is 
connected to the second receiving data buffer 18 for 
receiving the first multiplexed data to demultiplex the 
first multiplexed data into first image data and first voice 
data separated from each other. The first and second 
terminal devices 1 and 1 5 further have first arrci second 
decompressors 7 and 21 respectively for deconrtpress- 
ing the image data and the voice data separately The 
first decompressor 7 is connected to the first demulti- 
plexer 9 for receiving the second image data and the 
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second voice data to expend the second image data 
and the second voice data separately. The second 
decompressor 23 is connected to the second demulti- 
plexer 21 for receiving the first image data and the first 
voice data to expend the first image data and the first 5 
voice data separately. The first and second terminal 
devices 1 and 1 5 further have first and second speakers 
4 and 26 as well as first and second displays 5 and 27 
respectively for re-producing the voice data and the 
image data. The first speaker 4 is connected to the first u 
decompressor 7 for receiving the second voice data 
from the first decompressor 7 to reproduce the second 
voice data as a voice. The first display 5 is also con- 
nected to the first decompressor 7 for receiving the sec- 
ond tnnage data from the first decompressor 7 to ,5 
reproduce the second image data on a screen of the 
first display 5. The second speaker 26 is connected to 
the second decompressor 23 for receiving the first voice 
data from the second deconrpressor 23 to reproduce 
the first voice data as a voice. The secorrd display 27 is so 
also connected to the second decompressor 23 for 
receiving the first irtiage data from the second decdm- 
pressor 23 to reproduce the first image data on a screen 
of the second display 27. 

[0065] The first and second terminal devices 1 and 1 5 25 
also have first and second data controllers 10-1 and 19- 
1 respectively. The first data controller 10-1 has both a 
nronrtoring function for monrtoring a current state of 
transfer of the image data and voice data through the 
general communication line 14 and a controlling tunc- 30 
tion for controlling transfers of the image data and the 
voice data, so that a priority is given to the transfer of the 
voice data whilst the transfer of the image data is con- 
trolled or discontinued in order to continue a current 
transfer of the voice data when the controller recognizes 35 
a delay in transfer of multiplexed data containing the 
image and voice data on the general communication 
line 14. The second data controller 19-1 has both a 
monitoring function for nrronitoring a current state of 
transfer of the image data and voice data through the 40 
general communication line 14 and a controlling func- 
tion for controlling transfers of the image data and the 
voice data, so that a priority is given to the transfer of the 
voice data whilst the transfer of the image data is con- 
trolled or discontinued in order to continue a current 45 
transfer of the voice data when the controller recognizes 
a delay in transfer of multiplexed data containing the 
image and voice data on the general comnuini cation 
line 1 4. The first data controller 1 0-1 is connected to the 
first communiqaton device 13 for receiving an informa- 50 
tion about an amount of the multiplexed data accumu- 
lated in the first transmitting side data buffer 11 for 
subsequent transfer through the communication line 14 
in order to monitor, through the first communication 
device 13. the amount of the multiplexed data accumu- 55 
lated in the first transmitting side data buffer 1 1 . so that 
only when the amount of the multiplexed data accumu- 
lated in the first transmitting side data buffer 1 1 exceeds 



a predetermined level, then the above control function 
of the first data controller 10-1 is activated. The second 
data controller 19-1 is also connected to the second 
communication device 16 for receiving an infornoation 
about an amount of the multiplexed data accumulated in 
the second transmitting side data buffer 17 for subse- 
quent transfer through the communication line 14 in 
order to monitor, through the first communication 'device 
16. the amount of the multiplexed data accunuilated in 
the second transmitting side data twffer 1 7, so that only 
when the amount of the multiplexed data accumulated 
in the second transmitting side data buffer 1 7 exceeds a 
predetermined level, then the above control function of 
the second data controller 19-1 is activated. The first 
data controller 1 0-1 is further connected to the first com- 
pressor 6 to send the first compressor 6 an instruction 
of changing an image data compression format in order 
to control the transfer of the image data by changing an 
original image data format defining a first data transfer 
rate as a normal data transfer rate to other image data 
format defining a second data transfer rate whic^ is 
lower than the first data transfer rate when the first data 
controller 10-1 recognizes the delay in transfer of the 
image data and the voice data on the communication 
line in accordance with the information about the data 
accumulation in the first transmitting side data buffer 1 1 
supplied from the first communication device 13. The 
second data controller 19-1 is further connected to the 
second connpressor 22 to send the second compressor 
22 an instruction of changing an image data compres- 
sion format in order to control the transfer of the image 
data by changing an original image data format defining 
a first data transfer rate as a normal data transfer rate to 
other image data format defining a second data transfer 
rate which is lower than the first data transfer rate when 
the second data controller 19-1 recognizes the delay in 
transfer of the image data and the voice data on the 
communication line in accordance with the information 
about the data accumulation in the second transmitting 
side data buffer 17 supplied from the second communi- 
cation device 16. The first data controller 10-1 further 
controls the transfer of the image data by returning the 
other image data format into the original image data for- 
mat when the first data controller 10-1 recognizes no 
delay in transfer of the image data and the vorce data on 
the general communication Hne 14. The second data 
controller 19-1 further controls the transfer of the image 
data by returning the other image data format into the 
original image data format when the second data con- 
troller 19-1 recognizes no delay in transfer of the image 
data and the voice data on the general communication 
line 14. The first data controller 10-1 further controls the 
transfer of the image data by further changing the other 
image data format into still other image data format 
defining a third data transfer rate which is lower than the 
second data transfer rate when the first data controller 
10-1 still recognizes the delay in transfer of the image 
data and the voice data on the general communication 
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line 14. The second data controller 19-1 further controls 
the transfer of the image data by further changing the 
other image data format into still other image data for- 
mat defining a third data transfer rate which is lower 
than the second data transfer rate when the second 5 
data controller 19-1 still recognizes the delay in transfer 
of the image data and the voice data on the general 
communication line 14. The first data controller 10-1 fur- 
ther controls the transfer of the image data by returning 
the still other image data format into the other image w 
data format when the first data controller 10-1 recog- 
nizes no delay in transfer of the image data and the 
voice data on the general communication line 14. The 
second data controller 19-1 further controls the transfer 
of the image data by returning the still other image data 75 
format into the other image data format when the sec- 
ond data controller 19-1 recognizes no delay in transfer 
of the image data and the voice data on the general 
communication line 14. The first data controller 10-1 fur- 
ther controls the transfer of the image data by discontin- 20 
uing the transfer of the image data only when the first 
data controller 10-1 still recognizes the delay in transfer 
of the image data and the voice data on the general 
communication line 1 4 even after the first data controller 
10-1 changes the image data format into a final image 2s 
data format defining a lowest data transfer rate. The 
second data controller 1 9-1 further controls the transfer 
of the image data tyy discontinuing the transfer of the 
image data only when the second data controller 19-1 
still recognizes the delay in transfer of the image data 30 
and the voice data on "the general communication line 
14 even after the second data controller 19-1 changes 
the image data format into a final image data format 
defining a lowest data transfer rate. The first data con- 
troller 10-1 further controls the transfer of the image 35 
data by re-starting the image data transfer when the first 
data controller 10-1 recognizes no delay in transfer of 
the image data and the voice data on the general com- 
munication line 14. The second data controller 19-1 fur- 
ther controls the transfer of the image data by re- 40 
starting the image data transfer when the second data 
controller 19-1 recognizes no delay in transfer of the 
image data and the voice data on the general communi- 
cation line 14. The first data controller 10-1 controls the 
current transfer of the voice data only when the first data 45 
controller 10-1 still recognizes the delay in transfer of 
the image data and the voice data on the general com- 
munication line 14 even the transfer of the image data is 
discontinued, wherein the first data controller 10-1 
sends the first connpressor 6 an instruction of changing 50 
an original voice data compression format into other 
voice data compression format which is lower than the 
original voice data compression format, in order to con- 
trol the transfer of the voice data. The second data con- 
troller 19-1 controls the current transfer of the voice data 55 
only when the second data controller 19-1 still recog- 
nizes the delay in transfer of the image data and the 
voice data on the general communication line 14 even 



the transfer of the image data is discontinued, wherein 
the second data controller 19-1 sends the second com- 
pressor 22 an instruction of changing an original voice 
data conpression format into other voice data compres- 
sion format which is lower than the original voice data 
compression format, in order to control the transfer of 
the voice data. 

SECOND EMBQDIMEfMT 

[0066] A second emtKxJim^ according to the present 
invention will be described in detail with reference to 
FIG. 3 which is a block diagram illustrative of a novel 
video conference system for transferring innage data 
and voice data through a general communication line 
between two terminal devices. The novel video confer- 
ence data transfer system comprises two terminal 
devices 1 and 15 and a communication line 14 connect- 
ing the two terminal devices 1 and 15 to each other or 
transfen-ing image data and voice data for the video 
conference. The two terminal devices 1 and 15 will be 
referred to as a first terminal device 1 and a second ter- 
minal device 1 5 which have the same structure and con- 
figurations. The first and second terminal devices 1 and 
15 have first and second microphones 2 arid 24 respec- 
tively for capturing voices. The first and second terminal 
devices 1 and 1 5 also have first and second cameras 3 
and 25 respectively for capturing images. The first and 
second terminal devices 1 and 15 also have first and 
second data compressors 6 and 22 respectively The 
first compressor 6 is connected to the first microphone 
2 and the first camera 3 for receiving image data cap- 
tured by the first camera 3 and voice data captured by 
the first microphone 2 to compress the received image 
data and the received voice data. The second compres- 
sor 22 is also connected to the second nticrophone 24 
and the first camera 25 for receiving image data cap- 
tured by the second camera 25 and voice data captured 
by the second microphone 24 to contpress the received 
image data and the received voice data. The first and 
second terminal devices 1 and 15 also have first and 
second multiplexers 8 and 20 respectively for multiplex- 
ing image data and voice data. The first multiplexer 8 is 
connected to the first data conpressor 6 for receiving 
the compressed inr«ge data and the compressed voice 
data from the first data connpressor 6 to multiplex the 
compressed image data and the compressed voice 
data. The second multiplexer 20 is connected to the 
second data compressor 22 for receiving the com- 
pressed image data and the corrpressed voice data 
from the second data compressor 22 to multiplex the 
compressed image data and the compressed voice 
data. The first and second terminal devices 1 and 15 
also have first and second transmission data buffers 1 1 
and 17 respectively for temporary storing the multi- 
plexed data. The first transmission data buffer 1 1 is con- 
nected to the first multiplexer 8 for receiving and 
temporary storing the multiplexed data. The second 
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transmission data buffer 17 is connected to the second 
multiplexer 20 for receivirig and tenporary storing the 
multiplexed data. The first and second terminal devices 
1 and 15 also have first and second comnujnication 
devices 13 and 16 respectively. The first and second 5 
communication devices 13 arxj 16 are connected to 
each other through the communication tine 14. The first 
communication device 13 is connected to the first trans- 
mission data buffer 1 1 for receiving the first multiplexed 
data from the first transmission data buffer 1 1 to trans- jc 
mil the first multiplexed data through the communication 
line 14 to the second communication device 16. On the 
other harKi, the second communication device 16 is 
connected to the second transmission data fcwjffer 1 7 for 
receiving the second multiplexed data from the second 75 
transmission data Ixiffer 17 to transmit the second mul- 
tiplexed data through the communication line 14 to the 
first communication device 13. The first communication 
device 1 3 receives the second multiplexed data from the 
second communication device 16. whilst the second so 
communication device 16 receives the first multiplexed 
data from the first oomnminication device 13. The first 
and second terminal devices 1 and 15 further have first 
and second receiving data buffers 12 and 18 respec- 
tively for temporary storing the received data. The first 25 
receiving data buffer 1 2 is connected to the first commu- 
nication device 1 3 for receiving the second nnultiplexed 
data from the first communication device 13 to tempo- 
rary store the second multiplexed data. The second 
receiving data buffer 13 is connected to the second 30 
communication device 16 for receiving the first multi- 
plexed data from the secorxJ communication device 16 
to temporary store the first multiplexed data. The first 
and second terminal devices 1 and 15 further have first 
and second demultiplexers 9 and 21 respectively for 35 
separating the multiplexed data into voice and image 
data. The first demultiplexer 9 is connected to the first 
receiving data buffer 12 for receiving the second multi- 
plexed data to demultiplex the second multiplexed data 
into second image data and second voice data sepa- 40 
rated from each other. The second demultiplexer 21 is 
connected to the second receiving data buffer 18 for 
receiving the first multiplexed data to demultiplex the 
first multiplexed data into first image data and first voice 
data separated from each other. The first and second 45 
terminal devices 1 and 15 further have first and second 
decompressors 7 and 21 respectively for deconpress- 
ing the image data and the voice data separately. The 
first deconrpressor 7 is connected to the first demulti- 
plexer 9 for receiving the second image data and the 50 
second voice data to expend the second image data 
and the second voice data separately. The second 
decompressor 23 is connected to the second demulti- 
plexer 21 for receiving the first innage data and the first 
voice data to expend the first image data and the first 55 
voice data separately. The first and second terminal 
devices 1 and 15 further have first and second speakers 
4 and 26 as well as first and second displays 5 and 27 



respectively for re-producing the voice data and the 
image data. The first speaker 4 is connected to the first 
decompressor 7 for receiving the second voice data 
from the first decompressor 7 to reproduce the second 
voice data as a voice. The first display 5 is also con- 
nected to the first decorrpressor 7 for receiving the sec- 
ond image data from the first deconnpressor 7 to 
reproduce the second'image data on a screen of the 
first display 5. The second speaker 26 is connected to 
the second deconpressor 23 for receiving the first vorce 
data from the second decompressor 23 to reproduce 
the first voice data as a voice. The second display 27 is 
also connected to the second decompressor 23 for 
receiving the first image data from the second decom- 
pressor 23 to reproduce the first image data on a screen 
of the second display 27. 

[0067] The first and second terminal devices 1 and 1 5 
also have first and second data controllers 1 C-2 and 1 9- 
2 respectively The first data controller 10-2 has both a 
monitoring function for monitoring a load of a first CPU 
provided in the first compressor 6 in the first terminal 
device 1 for data compressing operations and a control- 
ling function for controlltng processing speeds of the 
image data and the voice data by the first CPU. so that 
the priority is given to the processing of the voice data 
by the first CPU whilst the processing of the image data 
by the first CPU is controlled or discontinued in order to 
continue the current processing speed of the voice data 
by the first CPU when the first data controller 10-2 rec- 
ognizes an over-load of the first CPU The second data 
controller 19-2 has both a monitoring function for moni- 
toring a load of a second CPU provided in the second 
compressor 22 in the second terminal device 15 for data 
conpressing operations and a controlling function for 
controlling processing speeds of the innage data and the 
voice data by the second CPU so that the priority is 
given to the processing of the voice data by the second 
CPU whilst the processing of the image data by the sec- 
ond CPU is controlled or discontinued in order to con- 
tinue the cunrent processing speed of the voice data by 
the second CPU when the second data controller 19-2 
recognizes an over-load of the second CPU. The first 
data controller 10-2 is connected to the first communi- 
cation device 1 3 for receiving, through the first commu- 
nication device 13. about informations of an amount of 
the image data and the voice data accumulated in the 
first transmitting side data buffer 11 for subsequent 
transfer through the general comnujnication line 14 in 
order to monitor the amount of the accumulated image 
and voice data, so that only when the amount of the 
image and voice data accumulated in the first transmit- 
ting side data buff©- 11 is less tfian a predetermined 
level, then the control function of the first data controller 
10-2 is activated. The second data controller 19-2 is 
connected to the second communication device 16 for 
receiving, through the second communication device 
16. about informations of an amount of the image data 
and the voice data accumulated in the second transmit- 
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ting side data buffer 17 for subsequent transfer through 
the general communication line 14 in order to monitor 
the amount of the accumulated image and voice data, 
so that only when the amount of the image and voice 
data accumulated in the second transnriitting side data 5 
buffer 17 is less than a predetermined level, then the 
control function of the second data controller 19-2 is 
activated. The first data controller 10-2 is also con- 
nected to the first data compressor 6 for sending the 
first data compressor 6 an instruction to (Grange an orig- to 
inat image data processing speed format defining a first 
image data processing speed as a normal image data 
processing speed to other image data processing 
speed format defining a second image data processing 
speed which is lower than the first image data process- 15 
ing speed when the first data controller 10-2 recognizes 
the over-load of the first CPU, so as to control the 
processing speed of the image data. The second data 
controller 19-2 is also connected to the second data 
conpressor 22 for sending the second data compressor 30 
22 an instruction to change an original image data 
processing speed format defining a first image data 
processing speed as a normal image data processing 
speed to other image data processing speed format 
defining a second image data processing speed which 
is lower than the first image data processing speed 
when the second data controll©* 19-2 recognizes the 
over-load of the second CPU. so as to control the 
processing speed of the image data. The first data con- 
troller 1 0-2 further controls the processing speed of the 30 
image data by returning the other image data process- 
ing speed format into the original image data process- 
ing speed format when the first data controller 10-2 
recognizes no over-load of the first CPU. The second 
data controller 19-2 further controls the processing 35 
speed ol the image data by returning the other image • 
data processing speed formal into the original image 
data processing speed format when the second data 
controller 19-2 recognizes no over-load of the second 
CPU. The first data controller 10-2 further controls the 40 
processing speed of the image data by sending the first 
data compressor 6 an instruction of further changing the 
other image data processing speed format into still 
other image data processing speed format defining a 
third data processing speed which is lower than the sec- 45 
ond data processing speed when the first data controller 
10-2 still recognizes the over-load of the first CPU. The 
second data controller 19-2 further comrols the 
processing speed of the image data by sending the sec- 
ond data compressor 22 an instruction of further chang- $0 
ing the other image data processing speed format into 
still other image data processing speed format defining 
a third data processing speed which is lower than the 
second data processing speed when the second data 
controller 19-2 still recognizes the over-load of the sec- 55 
ond CPU. The first data controller 10-2 further controls 
the processing speed of the image data by returning the 
still other image data processing speed format into the 
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other image data processing speed format when the 
first data controller 10-2 recognizes no over-load of the 
first CPU. The second data controller 10-2 further con- 
trols the processing speed of the image data by return- 
ing the still other image data processing speed format 
into the other image data processing speed format 
when the second data controller 19-2 recognizes no 
over-load of ttre second CPU. The first data controller 
10-2 further controls the processing speed of the image 
data by sending the first data compressor 6 an instruc- 
tion of discontinuing the data compression processing 
of the image data only when Ihe first data controller 10- 
2 still recognizes the over-load of the first CPU even 
after the first data controller 10-2 has changed the 
image data processing speed format into a final image 
data processing speed format defining a lowest data 
processing speed. The second data controller 19-2 fur- 
ther controls the processing speed of the image data by 
sending the secorxj data compressor 22 an instruction 
of discontinuing the data compression processing of the 
image data only when the second data controller 19-2 
still recognizes the over-load of the second CPU even 
after the second data controller 19-2 has changed the 
image data processing speed format into a final image 
data processing speed format defining a lowest data 
processing speed. The first data controller 10-2 further 
controls the processing speed of the image data by re- 
starting the still oXh& image data compression process- 
ing when the controller recognizes no over-load of the 
first CPU. The second data controller 19-2 further con- 
trols the processing speed of the image data by re-start- 
ing the stilf other image data compression processing 
when the controller recognizes no over-load of the sec- 
ond CPU. The first data controller 10-2 controls the cur- 
rent processing speed of the voice data by sending the 
first data compressor 6 an instruction of changing an 
original voice data compression fornwt defining a first 
data compression rate as a normal data compression 
rate into another voice data compression format defin- 
ing a second data compression rate which is lower than 
the first data compression rate only when the first data 
controller 10-2 still recognizes the over-load of the first 
CPU even after the processing of compression of the 
image data has been discontinued. The second data 
controller 19-2 controls the current processing speed of 
the voice data by sending the second data compressor 
22 an instruction of changing an original voice data 
compression format defining a first data compression 
rate as a normal data compression rate into another 
voice data compression format defining a secorKi data 
compression rate which is lower than the first data com- 
pression rate only when the second data controller 19-2 
still recognizes the over-load of the second CPU even 
after the processing of compression of the image data 
has been discontinued. 

[0068] Whereas modifications of the present invention 
will be apparent to a person having ordinary skill in the 
art. to which the invention pertains, it is to be under- 
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4. 



Stood that embodiments as shown and described by 
way of illustrations are by no unit intended to be consid- 
ered in a limiting sense. Accordingly, it is to be intended 
to cover by claims all modifications which tall within the 
spirit and scope of the present invention. 

Claims 

1 . A system for transferring multiplexed data including 
image data and voice data through at least a com- 
munication line between at least two ternrBnal 
devices, characterized in that said system includes: 

a monitoring means for monitoring a current 
state of transfer of said mult?5lexed data on 
said communication line ; and 
a controller means for controlling transfers of 
said image data and said voice data, so that a 
priority is given to said transfer of said voice 
data whilst said transfer of said image data is 
controlled or discontinued in order to continue 
a cun-ent transfer of said voice data when said 
monitoring means recognizes a delay in trans- 
fer of said multiplexed data on said communi- 
cation line. 

2. The system as claimed in claim 1 , characterized in 
that said controller means controls said current 
transfer of said voice data only when said monitor- 
ing means still recognizes said delay in transfer of 
said multiplexed data on said comnnunication line 
even after said transfer of said image data has been 
discontinued. 

3. The system as claimed in claim 1 , characterized in 
that said monitoring means is operated to monitor 
an amount of said multiplexed data accumulated in 
a data storage means lor subsequent transfer 
through said communication tine so that only when 
said amount of said multiplexed data accumulated 
in said data storage means exceeds a predeter- 
mined level, then said controller means performs 
said control operation. 

The system as daimed in claim 1 , characterized in 
that said controller means controls said transfer of 
said image data by changing an original image data 
fornrat defining a first data transfer rate as a normal 
data transfer rate to other image data format defin- 
ing a second data transfer rate which is lower than 
said first data transfer rate when said monitoring 
means recognizes said delay in transfer of said 
multiplexed data on said communication line. 

The system as claimed in claim 4. characterized in 
that said controller means further controls said 
transfer of said image data by returning said other 
image data format irto said original image data for- 
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mat when said monitoring means recognizes no 
delay in transfer of said multiplexed data on said 
communication line. 

The system as claimed in claim 4, characterized in 
that said controller means further controls said 
transfer of said image data by further changing said 
other image data format into still other image data 
format defining a third data transfer rate which te 
lower than said second data transfer rate when said 
monitoring means still recognizes said delay in 
transfer of said multiplexed data on said communi- 
cation line. 

The system as claimed in claim 6, characterized in 
that said controller means further controls said 
transfer of said image data by returning said still 
other image data format into said other image data 
format when said monitoring means recognizes no 
delay in transfer of said multiplexed data on said 
communication line. 

The system as claimed in claim 4, characterized in 
that said controller means further controls said 
transfer of said image data by discontinuing said 
transfer of said image data only when said monitor- 
ing means still recognizes said delay in transfer of 
said multiplexed data on said communication line 
even after said controller means changes saki 
image data format into a final image data format 
defining a lowest data transfer rate. 

The system as claimed in claim 8, characterized in 
that said controller means further controls said 
transfer of said image data by re-starting said still 
other image data format when said monitoring 
means recognizes no delay in transfer of said multi- 
plexed data on said communication line. 

The system as claimed in claim 1. characterized in 
that said monitoring means and said controller 
means are realized by a data controller provided in 
each of said terminal devices. 



11. The system as claimed in claim 1, characterized in 
that monitoring means further monitors a load of a 
processor provided in each of said terminal devices 
tor permitting said controller means to control 
processing speeds of said image data and said 
voice data by said processor, so that said priority is 
given to said processing of said voice data whilst 
said processing of said image data is controlled or 
discontinued in order to continue said current 
processing speed of said voice data when said 
monitoring means recognizes an over-load of said 
processor. 

1 2. The system as claimed in claim 1 1 , characterized in 
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that said controller means controls said current 
processing speed of said voice data only when said 
controller means still recognizes said over-load of 
said processor even after said processing of said 
image data has been discontinued. 5 

1 3. The system as claimed in claim 1 1 , characterized in 
that said monitoring means is operated to monitor 
an amount of said multiplexed data accumulated in 

a data storage means for sutisequerrt transfer 10 
through said communication line so that only when 
said amount of said multiplexed data accumulated 
in said data storage means is less than a predeter- 
mined level, then said controller means performs 
said control operation. 15 

14. The system as claimed in claim 1 1 , characterized in 
that sard controller means controls said processing 
speed of said image data by changing an original 
image data processing speed format defining a first so 
data processing speed as a nornr^l data process- 
ing speed to other image data processing speed 
format defining a second data processing speed 
which IS lower than said first data processing speed 
when said monitoring means recognizes said over- 25 
load of said processor 

15. The system as claimed in claim 14. characterized in 
that said controller means further controls said 
processing speed of said image data by returning 30 
said other image data processing speed format into 
said original image data processing speed fornrtat 
when said monitoring means recognizes no over- 
load of said processor. 

35 

1 6. The system as claimed in claim 1 4, characte-ized in 
that said controller means further controls said 
processing speed of said image data by further 
changing said other image data processing speed 
format into still other image data processing speed 40 
format defining a third data processing speed which 

is lower than said second data processing speed 
when said monitoring means still recognizes said 
over-load of said processor. 

45 

1 7. The system as claimed in claim 1 6, characterized in 
that said controller means further controls said 
processing speed of said image data by returning 
said still other image data processing speed format 
into said other image data processirig speed format so 
when said monitoring means recognizes no over- 
load of said processor. 

18. The system as claimed in claim 1 4. characterized in 
that said controller means further controls said 55 
processing speed of said image data by discontinu- 
ing said processing of said image data only when 
said monitoring means still recognizes said over- 



load of said processor even after said controller 
means changes said image data processing speed 
format into a final image data processing speed for- 
mat defining a lowest data processing speed. 

19. The system as claimed in daim 18, characterized in 
that said controller means further controls said 
processing speed of said image data by re-starting 
said still other image data conpression processing 
when said monitoring means recognizes no over- 
load of said processor. 

20. The system as claimed in claim 1 1 . characterized in 
that said controller means controls said processing 
speed of said image data by controlling an opera- 
tion of a compressor provided each of said terminal 
devices. 

21. A system for transferring multiplexed data including 
image data and voice data through at least a com- 
munication line between at least two terminal 
devices, characterized in that said system includes 



a monitoring means for monitoring a load of a 
processor provided in each of said terminal 
devices : and 

a controller means for controlling processing 
speeds of said image data and said voice data, 
so that said priority is given to said processing 
of said voice data whilst said processing of said 
image data is controlled or discontinued in 
order to continue said current processing 
speed of said voice data when said monitoring 
means recognizes an over-load of said proces- 
sor. 

22. The system as claimed in claim 21 , characterized in 
that said controller means controls said cun^ent 
processing speed of said voice data only when said 
processing of said image data is discontinued. 

23. The system as claimed in claim 21, characterized in 
that said monitoring means is operated to monitor 
an amount of said multiplexed data accumulated in 
a data storage means for subsequent transfer 
through said communication line so that only when 
said amount of said multiplexed data accumulated 
in said data storage means is less than a predeter- 
mined level, then said controller means performs 
said control operation. 

24. The system as claimed in daim 21, characterized in 
that said controller means controls said processing 
speed of said image data by changing an original 
image data processing speed format defining a first 
data processing speed as a normal data process- 
ing speed to other image data processing speed 
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format defining a second data processing speed 
which is lower than said first data processing speed 
when said monitoring means recognizes said over- 
load of satd processor. 

5 

25. The system as claimed in cJaim 24, characterized In 
that said controller means further controls said 
processing speed of said image data by returning 
said other image data processing speed format into 
sard original image data processing speed format io 
when said monitoring means recognizes no over- 
load of said processor. 

26. The system as claimed in claim 24. charaaerized in 
that said controller means further controls said is 
processing speed of said image data by further 
changing said other image data processing speed 
format into still other image data processing speed 
format defining a third data processing speed which 

is lower than said second data processing speed 20 
when said monitoring means still recognizes said 
over-load of said processor. 

27. The system as claimed in claim 26, characterized in 
that said controller means further controls said 25 
processing speed of said innage data by returning 
said still other image data processing speed format 
into said other image data processing speed format 
when said monitoring means recognizes no over- 
load of said processor. 30 

28. The system as claimed in claim 24, characterized in 
that said controller means further controls said 
processing speed of said image data by cfiscontinu- 

ing said processing of said image data only when -35 
sard monitoring means still recognizes said over- 
load of said proctor even after said controller 
means changes said image data processing speed 
format into a final image data processing speed for- 
mat defining a lowest data processing speed. 40 

29. The system as claimed in claim 28. characterized in 
that said controller means further controls said 
processing speed of said innage data by re-starting 
said still other image data compression processing 4s 
when said monitoring means recognizes no over- 
load of said processor. 

30. The system as claimed in claim 21 , characterized in 
that said controller means controls said pM-ocessing 50 
speed of said image data by controlling an opera- 
tion of a compressor provided each of said terminal 
devices. 

31 . The system as claimed in claim 2 1 . characterized in 55 
that said monitoring means further monitors a cur- 
rent state of transfer of said multiplexed data on 
said communication line so as to permit said con- 



troller means to further control transfers of said 
image data and said voice data, so that a priority is 
given to said transfer of said voice data whilst said 
transfer of said image data is controlled or discon- 
tinued in order to continue a current transfer of said 
voice data when sard nronitoring means recognizes 
a delay in transfer of said multiplexed data on said 
communication line. 

32. The system as daimed in claim 31 . characterized in 
that said controller means controls said current 
transfer of said voice data only when sard monitor- 
ing means still recognizes said delay in transfer of 
said multiplexed data on said communication line 
even after sard transfer of said image data has been 
discontinued. 

33. The system as daimed in claim 31, characterized in 
that said monitoring means is operated to monitor 
an amount of said multiplexed data accumulated in 
a data storage means for subsequent transfer 
through said comnrtunicatron line so that only when 
said amount of said multiplexed data accumulated 
in said data storage means exceeds a predeter- 
mined level, then said controller means performs 
said control operation. 

34. The system as daimed in daim 31 . characterized in 
that said controller means controls said transfer of 
said image data by changing an original image data 
format defining a first data transfer rate as a normal 
data transfer rate to other image data format defin- 
ing a second data transfer rate which is lower than 
said first data transfer rate when said monitoring 
means recognizes said delay in transfer of said 
multiplexed data on said communication line. 

35. The system as daimed in claim 34, characterized in 
that said controller means further controls said 
transfer of said innage data by returning said other 
innage data format into said original image data for- 
mat when said monitoring means recognizes no 
delay in transfer of said multiplexed data on said 
communication line. 

36. The system as daimed in claim 34. characterized in 
that said controller means further controls said 
transfer of sard image data by further changing said 
other image data format into still other image data 
format defining a third data transfer rate which is 
lower than said second data transfer rate when said 
monitoring means still recognizes said delay in 
transfer of said multiplexed data on said communi- 
cation line. 

37. The system as daimed in claim 36, characterized in 
that said controller means further controls said 
transfer of said image data by returning said still 
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other image data format into said other image data 
format when said monitoring means recognizes no 
delay in tranter of said multiplexed data on said 
communication line. 

5 

38. The system as claimed in claim 34. characterized in 
that said controller means further controls said 
transfer of said inriage data by discontinuing said 
transfer of said image data only when said monitor- 
ing means still recognizes said delay in transfer of io 
said multiplexed data on said communication line 
even after said controller nieans changes said 
image data format into a final image data format 
defining a lowest data transfer rate. 

15 

39. The system as claimed in claim 38, characterized in 
that said controller means further controls said 
transfer of said image data by re-starting said still 
other image data format when said monitoring 
means recognizes no delay in transfer of said multi- so 
plexed data on said communication line. 

40. The system as claimed in claim 3 1 . characterized in 
that said monitoring means and said cc»itrolter 
means are realized by a data controller provided in ss 
each of said terminal devices. 



NSDOCID: <EP 0917365A2J > 



15 



EP 0 917 365 A2- 



FIG. 1 prior art 



5 1 



5 2 



5 3 



5 i 



5 5 



^ r ^5 9 ,6 I 



6 5 



6 v5 8 ,6 0 ,6 2 



3 



^6 T ^9 ,7 1 



r 2 



T 3 



7 4 



T S 



5 1 : first terminal device 
53 ! first camera 
55 : first display 
57 : first data decompressor 
59 : first demultiplexer 



52 : first microphone 
54 : first speaker 
56 : first data compressor 
58 : first multiplexer 
60 : first transmitting side data buffer 



61 : first receiving side data buffer 62 : first communication device 
63 : general commuiiication line 64 : second communication device 
65 : second terminal device 66 : second transmitting side data buffer 

67 : second receiving side data buffer 68 : second multiplexer 
69 ; second demultiplexer 70 : second data compressor 

71 : second data decompressor 72 : second microphone 
73 : second camera 74 : second speaker 

75 : second display 
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11 : fijst transmitting side data buffer 12 : first receiving side data buffer 
13 : first communication device 14 : general communication line 
15 : second terminal device 16 : second communication device 

17 : second transmitting side data buffer 

18 : second receiving side data buffer 

19-1 : second data controller 20 : second multiplexer 
21 : second demultiplexer 22 : second data compressor 

23 : second data decompressor 24 : second microphone 
25 : second camera 26 : second speaker 

27 : second display 
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I : first terminal device 2 : first microphone 
3 : first camera 4 : first speaker 

5 : first display 6 : first data compressor 

7 : first data decompressor 8 : fiist multiplexer 

9 : first demultiplexer 10-2 : first data controller 

II : first transmitting side data buffer 12 : first receiving side data buffer 
13 : first communication device 14 : general communication line 

15 : second terminal device 16 : second communication device 

17 : second transmitting side data buffer 

18 : second receiving side data buffer 

19-2 : second data controller 20 : second multiplexer 
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